Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Key technologies of distributed data stream processing based on big data
CHEN Fumei, HAN Dezhi, BI Kun, DAI Yongtao
Journal of Computer Applications    2017, 37 (3): 620-627.   DOI: 10.11772/j.issn.1001-9081.2017.03.620
Abstract614)      PDF (1326KB)(741)       Save
In the big data environment, the real-time processing requirement of data stream is high, and data calculations require persistence and high reliability. Distributed Data Stream Processing System (DDSPS) can solve the problem of data stream processing in big data environment. Besides, it has the advantages of scalability and fault-tolerance of distributed system, and also has high real-time processing capability. Four subsystems and their key technologies of the DDSPS based on big data were introduced in detail. The different technical schemes of each subsystem were discussed and compared. At the same time, an example of data stream processing system structure to detect Distributed Denial of Service (DDoS) attacks was introduced, which can provide the technical reference for data stream processing theory research and application technology development under big data environment.
Reference | Related Articles | Metrics